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ABSTRACT 

This evaluation report is a description of an 
integrated bilingual-bicultural program which attempted to improve 
student achievement in oral and literate mastery of both Spanish and 
English. The program was funded under the Elementary Secondary 
Education Act, Title VII and was in its third year of operation in 
New York City. Two hundred ninth and tenth grade Spanish dominant 
students participated in the program. Students were selected for the 
program by both referral from guidance counselors and voluntary 
enrollment. The objectives of the program were to improve language 
proficiency and academic achievement in mathematics, social studies, 
and science bilingual curricula. Other program objectives were 
improvement in school attendance, decline of the number of dropouts, 
and a decrease of student referrals to the guidance office for 
disciplinary problems. Teacher-made tests in mathematics, social 
studies, and science were administered at the end of the school year. 
Speaking and comprehension in English, and reading in Spanish were 
assessed by standardized tests in Spanish. All students in the 
project demonstrated improvement in these areas. The students also 
had fewer disciplinary problems and guidance referrals than the 
school as a whole. Additionally, significant improvement in speaking 
and English comprehension was achieved by the students. (JP) 
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Eastern District High School serves the Williamsb' T-o; Grer^.tipoint 
section of Brooklyn, in District #14, and is the focUi:: cr this 
Project. It has the highest concentration of Hispanic students in 
New York City's 93 public high schools. The current estimate is 
that 71% of the students are of Hispanic background and that 32.1% 
are language handicapped. More than 2,000 students in this high 
school are of Hispanic background; for a high percentage of these 
students Spanish is the dominant language. Eastern District High 
School ' s total enrollment is 3 , 260 students . 

The Integrated Bilingual Demonstration Project is in its third 
year of operation, beginning in September and ending in June. Buring 
the 1974-1975 school year, 200 students in the ninth and tenth K^'ades 
have been in the program. Students were selected into the program 
by both referral from guidance counselors and voluntary enrollment. 
Instruction, supervision and guidance, the principle thrust of the 
program have been provided by a director, six bilingual teachers, 
six educationaLrassistants , two family assistants, a bilingual 
guidance counselor and a secretary. 

The project is housed in a mini school facility separated from 
but adjacent to the Eastern District High School main building. 
Project students receive instruction in all major curriculum areas 
required for high school matriculation: language arts, social 
studies, science, mathematics, aesthetics, physical education and 
crafts. English as a second language and bilingual instruction in 
Spanish for social studies, science, and mathematics are vital 
components for the students. Cross-culturalizations is programmed 
through a component in Hispanic music, art and dance. Project 



students occasionally put on assembly and community programs to 
celebrate for themselves and others in the District events 
important to their Hispanic heritage. They also take field trips 
to various parts of New York City to strengthen their understanding 
of their environment. The project strives for its students to 
achieve oral and literate mastery of both Spanish and English, 
a positive self image, and mutual respect and understanding as 
must exist in a culturally pluralistic society. 

In addition to the instructional components, staff development, 
parental and community involvement, and materials acquisition and 
developments components have been planned for in the project design. 
The project plans to develop a practical course of study based on 
college-level training that will combine theory, practice, and 
professional in-service field experience in bilingual education 
that may be used as a model for reciprocal New York State teacher 
certification requirements nationwide. 

In summary, the project strives to develop an integrated 
bilingual-bicultural program that may serve as a model and 
demonstration center for the secondary schools in other parts of 
the city, the state, and the country. 



II. Evaluative Procedures 

The evaluation design prepared by the Office of Educational 
Evaluation specified that the following six objectives were to 
be assessed : 

Obj ective 1 . - At the end of the first school year, a more 
significant number of the project group will pass tests in 
mathematics, social studies, and science than those not 
engaged in the project. 

IA. Subj ects - All 200 children in the project. 

IB. Methods and Procedures - Teacher-made tests in mathe- 
matics, social studies, and science will be administered 
at the end of the school year, the passing mark on these 
tests will be 65%. After the number of students in each 
group receiving a passing mark in mathematics, social 
studies, and science is determined, percentages within 
each group and within each subject of pupils passing will 
be computed. The differences in these percentages for 

* the two groups will be compared and the difference will 
be noted. 

IC. Statistical and/or Qualitative Analysis - The differences 
in percentage of passing marks for the two groups will 

be noted and presented in tabular form. 

ID. Time Schedule - The final tests in math, social studies, 
and science will be constructed by the teachers and 
project coordinator at the end of May, 1975. The tests 
will be administered during the first week of June, 1975. 
Analysis of the test marks will take place during the 
second and third weeks of June, 1975. 
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Objective 2 . At the end of the school year, it will be 

demonstrated that the average attendance of the project will 

exceed the average attendance of the school. 

2A. Subjects - All 200 children in the project group. 

2B. Methods of Procedures - The attendance records of the 
students will be examined in the school. The mean 
percentage attendance rates for the project group and 
the school will be compared. 

2C. Statistical and/or Qualitative Analysis - The average 
percentage rates of attendance for the project group 
and the average attendance of the school will be compared 

2D. Time Schedule - The records of the school will be 

examined for rates of attendance during the second week 
of June, 1975. The attendance analysis and comparisons 
will be made during the second and third weeks of June, 
1975. 

Objective 3 . There will be fewer referrals, percentagewise 

from the project group to guidance counselors and deans of 

discipline than from the school as a whole. 

3A. Subj ects - All the students in the project group and 
the school who have been referred. 

3B. Statistical and/or Qualitative Analysis - The numbers 
of students in each class who have been referred to 
guidance counselors and/or deans of discipline will 
be noted. If there are fewer referrals percentagewise, 
from the project group than from the non-project group, 
then this objective will have been achieved. 
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3C. Time Schedule - The request of the teachers for referral 
information will be made during the week of May 7, 1975. 
The statistical procedures will be carried out during the 
week of May 14, 1975. 

Objective 4 . Newly-designed bilingual curriculum materials 

will be demonstrated by the project staff. 

4A. Subj ects - The coordinator and teachers of the Integrated 
Bilingual Project. 

4B.. Methods and Procedures - The bilingual teachers, together 
with the coordinator and curriculum specialist, will 
develop new curriculum materials geared to the bilingual 
student. A portfolio of these teacher-made materials will 
be presented to show the new bilingual materials constructed 
to meet the needs of the children in the program in the 
fields of mathematics, social studies, and science. 

4C. Statistical and/or Qualitative Analysis - Ko such analysis 
will be needed for this objective. A demonstration of 
these new materials will be suffici<^nt to prove the attain- 
ment of this objective, and recorded by the evaluator. 

4D. Time Schedule - The presentation of the specially-constructed 
curriculum material will take place toward the end of 
June, 1975. 

Objective 5 . The drop-out rate for the project group will be 
significantly lower, percentagewise, than that of the school 
as a whole . 

5A. Subj ects - All of the 200 pupils in the project. 
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5B. Methods and Procedures - The school records will be 
examined for statistics conceniing the niomber of dro, 
outs . 

5C. Statistical and/or Q ua litative Analysis - The v^^czentage 
drop-out rate for the two groups will be compared. If 
the drop-out rate is significantly lower for the project 
group as compared to the school as a whole, then this 
objective will have been attained. 

5D. Time Schedule - The examination of the school records 
for data on student drop-outs will be made during the 
week of May 14, 1975. The calculation of the statistics 
and their interpretation will be made during the week of 
May 27, 1975. 

Objective 6. The students in the project will have acquired, 
by the end of the school year, statistically significant 
proficiency in their own language, and they will have acquired 
sufficient proficiency in English to indicate statistically 
significant improvement in their ratings on the Puerto Rican 
Study Scale. 

6A. Subjects - All of the 200 pupils in the project. 

6B. Methods and Procedures - The Puerto Rican Study Scale 
and the Inter-American Spanish Reading Test will be 
administered on a pre/posttest basis. 

6C, Statistical and/or Qualitative Analysis - On the 

Inter-American Spanish Reading test, a correlated t test 
will be run between pre and posttest raw scores. On the 
Puerto Rican Study, the Median Test for correlated samples 
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will be run to measure statistically significant 
improvement . 

6D. Time Schedule - Both measures will be administered during 
the week of September 16, 1974, and again during the week 
of May 14, 1975. The calculation of the statistics and 
their interpretation will be made during the week of 
May 27, 1975. 

All but one of the above evaluative procedures were administered 

as planned. Objective #1 required modification because it was not 

possible to identify a comparable control group from students within 

Eastern District High School and not engaged in the project (See 

Mr. David Dicker's letter enclosed in the Appendix). Also, the 

1973-1974 project evaluation discussad the extreme difficulties the 

evaluator had with the control group: 

**Ther^ is a serious question, however, as to the 
comparability^of groups ... Clearly tYie groups were not 
comparable.**^ ^ 

Mr. Rexford, last year's program evaluator, determined that in 
lieu of a comparable control group he would analyze pre/posttest 
improvement for statistically significant growth using a correlated 
t test. This evaluation (1974-1975) shall continue, the prudent 
modification of last year's evaluation. 

Both testing periods , pre-testing administered shortly after 
the beginning of the project, andpost-testing administered shortly 
before the termination of the program were implemented on time. 
The total number of students in the program was 200. However, when 



(1) Moon, Jr. , Rexford G. , Integrated Bilingual Demonstration 
Project for High Schools , Office of Educational Evaluation, Board 
of Education of the City of New York, 1974. 
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one considers late entrants into the program, absentees and students 
who transfer to other schools during the year, it becomes clear why 
57-88% of the total population is the number of pupils with both 
pre andpost-test scores for analysis. 



III. F inding s 

This section shall present each objective of the evaluation 

followed by a table and explanation of the findings relative to 

that evaluative objective. 

Objective 1. - Teacher-Made Tests (Mathematics, Social 
Studies and Science)" 

All students in the project received instruction in mathematics, 
social studies, and science. Did these students demonstrate a 
statistically significant improvement in these subjects as measured 
by teacher-made tests .and analyzed on a pre/post-test basis by a 
correlated t test? Tables 1, 2 and 3 report that these students 
did demonstrate a statistically significant growth at the .05 
significance level . 

The Teacher-Made Test of Mathematics was either a pre-algebra, 
algebra or geometry examination as appropriate for the nine 
different math classes in the fall semester and eight different 
math classes in the spring semester. 

The Teacher-Made Test of Social Studies was either a Latin 
studies, American history, economics. Western Civilization, or 
Puerto Rican history examination as appropriate for the ten different 
social studies classes in each senester. 

The Teacher-Made Test of Science vyas either a general science 
or biology examination as appropriate for the ten different science 
classes in each semester. 

The evaluator examined the available data for these three exams 
and calculated the mean raw score growth between pre and post-test 
to be at minimum 20 points in each case. A correlated t test of 
the difference in pre and posttest performance indicated that the 

i3 
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'Tabic 1 


: Teacher Made-Test 


m na cneinauxco . 




Prc-Tcst 


Post- To St 


No. of Pupils (Group) 


17 


17 


Mean (Raw Score) 


43.21 


63.40 


Slandcird Devic;lion 


9.96 


9.61 


t Value 


6. 


06 


Results 


Significant Growth at .05 Level. 


'Table 2 


: Teacher Made-Test 


in Social Studies. 




Pre -Test 


Post- Test 


No, of Pupils (Groups 


20 


20 


Mean (Raw Score) 


46. .83 


74.67 


Standard Deviation 


9.58 


4.64 


t Value 


11.40 


Results 


Signficant Growth at .05 Level. 



'Tablo 3: Teacher Made-Test in Science. 





Pre- To St 


Post- Test 


Ho. of Pupils (Group) 


20 


20 


Mean (Raw Score) 


30.76 


69.21 


Standard Dcvlollon 


3.99 


8.52 


t value 


17.80 


Results 


Significant Growth 


at .05 Level. ^ 
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difference in performance was statistically significant at the .05 
level in each case. Therefore, the program did achieve significant 
growth in mathematics, social studies and science. 
Objective 2. - Attendance 

This objective seeks to determine if the average attendance 
of the project students was greater than the average attendance of 
the school. Table 4 reports that the average program attendance 
was greater than that of the school. 

Table 4: Project and School Attendance by Month. 

Project Attendance (%) School Atte n dance (70^ 

September 
October 
November 
December 
January 
February 
March 
April 

Average 

The mean percentage attendance of the project group was 86%, 
for the school it was 61%. A correlated t test of the difference 
in attendance percentages was significant at the .05 level (t score 
of 9.34). The evidence demonstr?.tes that the project was highly 
successful in achieving consistently high monthly attendance as 
well as the objective of a significantly higher average percentage 
than the control group. 

Objective 3> - Guidance ana Discipline 

This objective seeks to determine if there were fewer referrals 
from the project group to guidance counselors and deans of discipline 
than from the school as a whole. Table 5 reports that the above 
objective was accomplished. , ^ 



82 
85 
85 
86 
84 
87 
90 
91 



59 
58 
59 
64 
46 
65 
67 
69 
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Table 5: Project and School Referrals 

Week Program Referrals (%) School Referrals (yo) 

llZ-m 1 Not Available 

2/10-2/14 0 Not Available 

7 20 

515-519 1 • 13 

5/12-5/16 1 15 

Average 2 16 



Five random weekly periods were analyzed for percentages of 
students who were referred to guidance counselors and deans of 
discipline. There were fewer referrals percentagewise, from the 
project group than from the non-project group (167o) . 

Objective 4. - Bilingual Curriculum Materials 

Bilingual teachers, together with the coordinator and curriculum 
specialist were to have developed new bilingual curriculum materials 
in the fields of mathem^atics , social studies and science. A large 
quantity of high quality newly developed bilingual materials was 
demonstrated to the evaluator and therefore this objective was 
successfully attained. 

The newly developed bilingual science materials for biology 
are recorded herein as evidence of program achievement of this 
obj ective : 



Science - Biology 

1. Curriculum outline 

2. Program Study - 1st semester 
Program Study - 2nd semester 

3. Lessons 

I. Vital Functions (digestion, nutrition, absorbtion, 
respiration) 
II. Cell Theory 
III. Physiology of cells 
IV. Cell parts - citoplasm 

V. Cell Nucleus 
VI. Amoeba and Paramecium 
VII. Organs 
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4. Detailed lessons for above (I to VII). 

5. Multiple choice question. test on respiration. 

6. Outline and diagram on excretion. 

7. Outline on protozoa. 

8. Fill in test on respiration. 

9. Chart on elements and s3mibols (ex. C = Carbon). 

10. Outline on carbohydrates. 

11. Outline on carbon, nitrogen, hydrogen and oxygen. 

12. Outline on fertilization. 

13. Review - fill in type. 

14. Final exam (fill in, multiple choice). 

15. Many, many diagrams on all of the above (muscles, heart, 
cells , etc . ) . 

16. Many, many rexograph materials on above topics. 
Objective 5. - Drop-out Rate 

The drop-out rate for the project group and the school as a 
whole will be compared percentagewise. Table 6 shows that the 
program did do better than the school regarding drop-out rates. 

Table 6: Program and School Drop-out Rate. 



Month 


Sept 


Oct 


Nov 


Dec 


Jan 


Feb Mar Apr 


Average 


Program (%) 


0 


2 


4 


4 


0 


1 1 1 


1.6 


School (%) 


3 


3 


4 


4 


2 


2 3 2 


2.9 



The average percentage drop-out rate for the project group 
was 1.67o, whereas for the entire school it was 2.9%. A correlat 
t test of the difference in drop-out rates was significant at the ' 
.05 level (t score of 1.98). 

Objective 6^ - Speaking and Comprehension in English, 
Reading in Spanish . 

Ail program students received instruction in speaking and 
comprehension in English and reading in Spanish. Did these 
students demonstrate statistically significant improvement in 
these three areas as measured by the Puerto Rican Scale and 
the Interamerican Spanish Reading Test 2 Tables 7 and 8 report 
that these students did demonstrate significant growth on all 
three measures of this objective. (Lower scores on comprehension 
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are for greater ability.) 

Table 7: Puerto Rican Scale of English Language Ability, 



Speaking 
Score Fre-Rating Fost-Rating 



Comprehension" 





Number 


Number 


A 


0 


0 


B. 


23 


32 


C 


26 


40 


D 


34 


36 


E 


59 


34 


F 


0 


0 


6 


■ 0 


0 





Number 


Number 


1 


0 


4 


2 


23 


54 


3 


46 


56 


4 


45 


27 


5 


27 


1 


6 


1 


0 


7 


0 


0 



A total of 142 students were rated on the Puerto Rican Scale 
of English Language Ability Test in September of 1974 and then 
again in June of 1975. The median scores on the comprehension 
pre and post-ratings were 3.02 and '2.11 respecti.vely . The Median- 
Test for correlated samf les proved 80% of the post-ratings were 

better (lower) than the median of the pre-ratings. A X test 

2 

proved significant growth at the .05 level (X^ = 40.62). 

'Tciblc 8: Interamerican ,Tes t of Reading^- Prueba De Lectura. 





Pro--Tc£, 


t 


Pes 1- To si 


No. of Pupils 


113 






113 




Mocin (Raw Score) 


50. 


17 




62.86 




Slnndard Deviciiion 


22. 


58- 




20.51 




t value 




5. 


87 






Rcr.ulls 


Significant 


Growth at 


05 Level. 





A total of 113 students were given the Interamerican Prueba 
De Lectura on a pre and post-test basis. This instrument is a 
standardized test in Spanish with components covering: (1) vocabulary, 
(2) comprehension speed and (3) comprehension level. A perfect score 
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on this examination would be 125 points. 

The raw scores on the pre and posttest were 50.17 and 62.86 
respectively. A correlated t_ test of the difference in pre and 
posttest performance indicated that the difference in performance 
was statistically significant at the .05 level. 

Therefore,' the project did achieve significant growth in 
speaking, and comprehending in English and reading in Spanish. 

All of the year's program objectives have been implemented 
consistent with the program proposal. The preceding pages explain 
that all of the objectives were successfully achieved with statistically 
significant growth whenever applicable. 

Parental and community involvement was also significant. There 
were at least eight Parent Advisory Committee meetings and Parent 
Workshop meetings during the year. These meetings afforded partici- 
pant's parents the opportunity to learn, about the program and discuss 
its future improvement. The program also published an informative 
newsletter distributed to all concerned with the program. 

Many visitors came to see this project because of its somewhat 
unique physical arrangement in the mini-school. No doubt they were 
greatly impressed, as this evaluator was, by the exceptionally well 
disciplined and well-groomed student body housed there. The physical 
arrangement is responsible for only a small portion of this accom- 
plishment, for program staff earn a high level of respect from 
their students. This is truly admirable 1 

Bilingual teachers attended college courses at the City University 
of New York, aides attended programs of continuing education also. 
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Four paraprof essionals have already obtained their teaching 
licenses and are teaching in other programs in New York City. 
Two paraprof essionals are finishing their programs now. 

Numerous field trips have been carried out during the year: 

1. Camping trip - Woodland Valley Campsites 

2. Radio City Music Hall 

3. Flushing Meadow Park 

4. Musexom of Natural History 

5. Brooklyn Botantical Gardens 

6. Circus 

7. Metro^ojplitan Museum of Art 

8. Philadelphia 

Of particular achievement is the program's American Bicentennial 

History project. 

"In order to make the pupil more conscious of American 
history other than the usual manner of presentation in a 
classroom and the fact that the A^aerican Bicentennial is 
being celebrated, the pupil should in some form express his 
or her attitude toward the subject matter in relationship to 
the bicentennial. Due to the pupil's non-English background 
and the time allotted to complete the project, the teacher 
decided to use a visual approach with the written explanations 
and summaries representing the theme of the project. 

Individual student projects included: (1) The Presidency of the 

U. S. , (2) The Congress, (3) The American Indian and (4) Historical 

Places. This project was an outstanding success. 

The facilities and materials in the mini-school are excellent. 

Furthermore, the project has made the bulletin boards an integral 

part of the learning and educational process of the students. 

Because of their visual and informational benefits for the pupils, 

the faculty of the project with the cooperation of the pupils have 

decorated all the bulletin boards with various subject themes. 

A particularly excellent utilization of the four bulletin boards 



(2) Olivencia, N. and Ana Aponte, Integrated Bilingual 
Demonstration Project for High Schools - American History Project . 



in the hallways of the mini-school is a display conveying hispanic 
culture titled Pan American Culture. 

The project staff is benefiting from its relationship with 
other New York City High School Bilingual Programs, at John Jay, 
Nev7ton and Bushwick High Schools. The project is being used to 
some extent as a model for the Aspira Consent Degree Program which 
is funded by tax levy funds and has been instituted in the main 
building of the school. Eastern District High School was selected 
as a pilot program for this undertaking because of its successful 
bilingual project. In total the program is servicing the needs of 
the specific target population for which it was designed. 

Recommendations from the last prior study are also beinf^ 
implemented. That is, informal follow-up of students who leave the 
project and return to the mainstream of Eastern District High 
School is being undertaken by the project coordinator. More 
teachers in the main building are recognizing the need for increasing 
their abilities in Spanish and have signed up for courses given 
by the Board of Education. Last year's recommendations are impacting 
of this year's program operation. 
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IV. Summary of Major Findings, Conclusions and Recommendations 

All students in the project demonstrated statistically 
significant growth (at the .05 significance level as determined by 
a correlated it test) in: 

1 . mathematics 

2. social studies 

3. science 

4. monthly attendance (compared to the school as a whole) 

5. reading in Spanish 

They also had fewer guidance and discipline problems v;hen compared 
to the school as a whole. The project group also had fewer drop-outs 
than ttte school as a whole, on a percentage basis. They also showed 
significant growth in speaking and comprehension in English when 
analyzed by a Median Test. Tha program staff developed a tremendous 
volume of quality bilingual curriculum materials. The program was 
fully implemented as planned for in the program proposal. 

From these evaluations one must conclude that the program was 
highly successful in achieving all of its objectives. However, 
in relation to the long range program goals the evaluator recommends 
increased effort in integrating the project into the mainstream 
of Eastern District High School. There are a number of things that 
should be done, for example: (1) the staff of the project should 
give a short training program for teachers not in the program on 
how to work with Spanish-dominant students, (2) the staff of the 
project should work more closely on curriculum development with the 
appropriate department chairperson (mathematics, social studies, etc.), 
and (3) the staff should work on a more regular and formal basis on 
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academic follow-up of students who leave the project to enter the 
mainstream of Eastern District High School. Though the facilities 
in the mini-^^^chool are excellent, to truly integrate the project 
into the main building, space is needed in the main building for 
project meetings and classes. Similarly, though guidance is 
Gxcell^.uc in the project, bilingual guidance counselors are needed 
in the main building to facilitate the transition of students from 
the project to the main building and for those students not in the 
project who are in need of bilingual counseling services. 

With respect to future evaluations of this project, the 
evaluator recommends: (1) the addition of more objectives in the 
affective domain (such as, attitude, respect and citizenship), 

(2) the use of the correlated t^ test for pre and post-test analysis 
and the elimination of the control group whenever possible and 

(3) increasing the sample size by extending the testing period so 
as to pick up absentees. 

The project should definitely be continued since the District 
is in great need of bilingual educational opportunities for its 
students . 




